Hospital variation in rates of concurrent fundoplication during gastrostomy enteral access procedures.

BACKGROUND: This study aimed to determine whether (1) the propensity for concurrent fundoplication during gastrostomy varies among hospitals, and (2) postoperative morbidity differs among institutions performing fundoplication more or less frequently. METHODS: Children who underwent gastrostomy with or without concurrent fundoplication were identified in the American College of Surgeons National Surgical Quality Improvement Program Pediatric (ACS-NSQIP-P). A hierarchical multivariate regression modeled the excess effects that hospitals exerted over propensity for concurrent fundoplication adjusting for preoperative clinical variables. Hospitals were designated as low outliers (significantly lower-adjusted odds of concurrent fundoplication than the average hospital with similar patient mix), average hospitals, and high outliers based on their risk-adjusted concurrent fundoplication practice. The postoperative morbidity rates were compared among low-outlier, average, and high-outlier hospitals. RESULTS: Between 2011 and 2013, 3775 children underwent gastrostomy at one of 54 ACS-NSQIP-P participating hospitals. The mean hospital concurrent fundoplication rate was 11.7% (range 0-64%). There was no significant difference in unadjusted morbidity rate in children with concurrent fundoplication, 11.0% compared to 9.7% in children without concurrent fundoplication. After controlling for clinical variables, 8 hospitals were identified as low outliers (fundoplication rate of 0.4%) and 16 hospitals were identified as high outliers (fundoplication rate of 34.6%). The average unadjusted morbidity rate among hospitals with low, average, and high odds of concurrent fundoplication were 9.6, 10.6, and 8.4%, respectively. CONCLUSION: Hospitals vary significantly in propensity for concurrent fundoplication during gastrostomy yet postoperative morbidity does not differ significantly among institutions performing fundoplication more or less frequently.

Development and Evaluation of the American College of Surgeons NSQIP Pediatric Surgical Risk Calculator.

BACKGROUND: There is an increased desire among patients and families to be involved in the surgical decision-making process. A surgeon's ability to provide patients and families with patient-specific estimates of postoperative complications is critical for shared decision making and informed consent. Surgeons can also use patient-specific risk estimates to decide whether or not to operate and what options to offer patients. Our objective was to develop and evaluate a publicly available risk estimation tool that would cover many common pediatric surgical procedures across all specialties. STUDY DESIGN: American College of Surgeons NSQIP Pediatric standardized data from 67 hospitals were used to develop a risk estimation tool. Surgeons enter 18 preoperative variables (demographics, comorbidities, procedure) that are used in a logistic regression model to predict 9 postoperative outcomes. A surgeon adjustment score is also incorporated to adjust for any additional risk not accounted for in the 18 risk factors. RESULTS: A pediatric surgical risk calculator was developed based on 181,353 cases covering 382 CPT codes across all specialties. It had excellent discrimination for mortality (c-statistic = 0.98), morbidity (c-statistic = 0.81), and 7 additional complications (c-statistic > 0.77). The Hosmer-Lemeshow statistic and graphic representations also showed excellent calibration. CONCLUSIONS: The ACS NSQIP Pediatric Surgical Risk Calculator was developed using standardized and audited multi-institutional data from the ACS NSQIP Pediatric, and it provides empirically derived, patient-specific postoperative risks. It can be used as a tool in the shared decision-making process by providing clinicians, families, and patients with useful information for many of the most common operations performed on pediatric patients in the US.

Variation in intraoperative and postoperative red blood cell transfusion in pediatric surgery.

BACKGROUND: Intraoperative and postoperative red blood cell (RBC) transfusions are relatively frequent events tracked in the American College of Surgeons' National Surgical Quality Improvement Program-Pediatric (ACS-NSQIP-P). This study sought to quantify variation in RBC transfusion practices among hospitals. STUDY DESIGN AND METHODS: This is an observational study of children older than 28 days who underwent a general, neurologic, urologic, otolaryngologic, plastic, or orthopedic operation at 50 hospitals in participating in the ACS-NSQIP-P during 2011 to 2012. The primary outcome was whether or not a RBC transfusion was administered from incision time to 72 hours postoperatively. Transfusions of fresh-frozen plasma, cryoprecipitate, and platelets were excluded from data abstraction due the rarity of their administration. A multivariate hierarchical risk-adjustment model estimated the risk-adjusted hospital RBC transfusion odds ratio (OR) and designated hospitals by transfusion practice. RESULTS: The mean RBC transfusion rate was 1.5%. Five preoperative variables were associated with greater than threefold increased odds of having an intraoperative or postoperative RBC transfusion; young age; 29 days to 1 year (OR, 5.9; p < 0.001) and 1 to 2 years (OR, 3.4; p < 0.001); American Society of Anesthesiologists Class IV (OR, 3.2; p < 0.001); procedure linear risk (OR, 3.1; p < 0.001); preoperative septic shock (OR, 14.5; p < 0.001); and preoperative cardiopulmonary resuscitation (OR, 8.1; p < 0.001). Twenty-five hospitals had RBC transfusion practices significantly different than risk-adjusted mean (17 higher and eight lower). CONCLUSION: Intraoperative and postoperative RBC transfusion practices vary widely among hospitals after controlling for patient and procedural characteristics.

Estimating Adverse Events After Gastrostomy Tube Placement.

OBJECTIVE: Gastrostomy feeding tube placement in children is associated with a high frequency of adverse events. This study sought to preoperatively estimate postoperative adverse events in children undergoing gastrostomy feeding tube placement. METHODS: This was an observational study of children who underwent gastrostomy with or without fundoplication at 1 of 50 participating hospitals, using 2011-2013 data from the American College of Surgeons' National Surgical Quality Improvement Program Pediatric. The outcome was the occurrence of any postoperative complications or mortality at 30 days after gastrostomy tube placement. The preoperative clinical characteristics significantly associated with occurrence of adverse events were included in a multivariate logistic model. The area under the receiver operating characteristic curve was computed to assess model performance and split-set validated. RESULTS: A total of 2817 children were identified as having undergone gastrostomy tube placement. The unadjusted rate of adverse events within 30 days after gastrostomy tube placement was 11%. Thirteen predictor variables were identified. Notable preoperative variables associated with a greater than 75% increase in adverse event rate were preoperative sepsis/septic shock (odds ratio [OR], 10.76, 95% confidence interval [CI], 3.84-30.17), central nervous system tumor (OR, 3.36; 95% CI, 1.42-7.95), the primary procedure as indicated by the current procedural terminology (CPT) linear risk variable (OR, 1.93; 95% CI, 1.50-2.49), severe cardiac risk factors (OR, 1.88; 95% CI, 1.17-3.03), and preoperative seizure history (OR, 1.90; 95% CI, 1.38-2.62). The area under the receiver operating characteristic curve was 0.71 with the derivation data set and 0.71 upon split-set validation. CONCLUSIONS: Preoperatively estimating postoperative adverse events in children undergoing gastrostomy tube placement is feasible.

A risk calculator predicting postoperative adverse events in neonates undergoing major abdominal or thoracic surgery.

PURPOSE: This study sought to demonstrate the feasibility of a risk calculator for neonates undergoing major abdominal or thoracic surgery with good discriminative ability. METHODS: The American College of Surgeons' National Surgical Quality Improvement Program Pediatric (ACS-NSQIP-P) 2011-12 data were queried for neonates who underwent major abdominal or thoracic surgery. The outcome of interest was the occurrence of any adverse event, including mortality, within 30-days postoperatively. The preoperative clinical characteristics significantly associated with any adverse event were used to build a multivariate model. The model's discriminative ability was assessed with the area under the receiver operating characteristic curve (AUROC). The model was split-set validated with 2013 data. RESULTS: A total of 2967 neonates undergoing major abdominal or thoracic surgery were identified. The overall rate of adverse events was 23.3%. Sixteen variables were found to be associated with adverse events. Four variables increased the odds of adverse events at least two-fold: dirty or infected wound class [odds ratio (OR)=2.1] dialysis (OR=3.8), hepatobiliary disease (OR=2.1), and inotropic agent use (OR=2.6). The AUROC=0.79 for development data and 0.77 on split-set validation. CONCLUSION: Preoperatively estimating the probability of postoperative adverse events in neonates undergoing major abdominal or thoracic surgery with good discrimination is feasible.

The importance of extreme weight percentile in postoperative morbidity in children.

BACKGROUND: Anthropometric data are important indicators of child health. This study sought to determine whether anthropometric data of extreme weight were significant predictors of perioperative morbidity in pediatric surgery. STUDY DESIGN: This was a cohort study of children 29 days up to 18 years of age undergoing surgical procedures at participating American College of Surgeons' NSQIP Pediatric hospitals in 2011 and 2012. The primary outcomes were composite morbidity and surgical site infection. The primary predictor of interest was weight percentile, which was divided into the following categories: ≤5(th) percentile, 6(th) to 94(th), or ≥95(th) percentile. A hierarchical multivariate logistic model, adjusting for procedure case mix, demographic, and clinical patient characteristic variables, was used to quantify the relationship between weight percentile category and outcomes. RESULTS: Children in the ≤5th weight percentile had 1.19-fold higher odds of overall postoperative morbidity developing than children in the nonextreme range (95% CI, 1.10-1.30) when controlling for clinical variables. Yet these children did not have higher odds of surgical site infection developing. Children in the ≥95(th) weight percentile did not have a significant increase in overall postoperative morbidity. However, they were at 1.35-fold increased odds of surgical site infection compared with those in the nonextreme range when controlling for clinical variables (95% CI, 1.16-1.57). CONCLUSIONS: Both extremely high and extremely low weight percentile scores can be associated with increased postoperative complications after controlling for clinical variables.

Risk-adjusted hospital outcomes for children's surgery.

UNLABELLED: BACKGROUND The American College of Surgeons National Surgical Quality Improvement Program-Pediatric was initiated in 2008 to drive quality improvement in children's surgery. Low mortality and morbidity in previous analyses limited differentiation of hospital performance. METHODS: Participating institutions included children's units within general hospitals and free-standing children's hospitals. Cases selected by Current Procedural Terminology codes encompassed procedures within pediatric general, otolaryngologic, orthopedic, urologic, plastic, neurologic, thoracic, and gynecologic surgery. Trained personnel abstracted demographic, surgical profile, preoperative, intraoperative, and postoperative variables. Incorporating procedure-specific risk, hierarchical models for 30-day mortality and morbidities were developed with significant predictors identified by stepwise logistic regression. Reliability was estimated to assess the balance of information versus error within models. RESULTS: In 2011, 46 281 patients from 43 hospitals were accrued; 1467 codes were aggregated into 226 groupings. Overall mortality was 0.3%, composite morbidity 5.8%, and surgical site infection (SSI) 1.8%. Hierarchical models revealed outlier hospitals with above or below expected performance for composite morbidity in the entire cohort, pediatric abdominal subgroup, and spine subgroup; SSI in the entire cohort and pediatric abdominal subgroup; and urinary tract infection in the entire cohort. Based on reliability estimates, mortality discriminates performance poorly due to very low event rate; however, reliable model construction for composite morbidity and SSI that differentiate institutions is feasible. CONCLUSIONS: The National Surgical Quality Improvement Program-Pediatric expansion has yielded risk-adjusted models to differentiate hospital performance in composite and specific morbidities. However, mortality has low utility as a children's surgery performance indicator. Programmatic improvements have resulted in actionable data.

Optimizing ACS NSQIP modeling for evaluation of surgical quality and risk: patient risk adjustment, procedure mix adjustment, shrinkage adjustment, and surgical focus.

The American College of Surgeons National Surgical Quality Improvement Program (ACS NSQIP) collects detailed clinical data from participating hospitals using standardized data definitions, analyzes these data, and provides participating hospitals with reports that permit risk-adjusted comparisons with a surgical quality standard. Since its inception, the ACS NSQIP has worked to refine surgical outcomes measurements and enhance statistical methods to improve the reliability and validity of this hospital profiling. From an original focus on controlling for between-hospital differences in patient risk factors with logistic regression, ACS NSQIP has added a variable to better adjust for the complexity and risk profile of surgical procedures (procedure mix adjustment) and stabilized estimates derived from small samples by using a hierarchical model with shrinkage adjustment. New models have been developed focusing on specific surgical procedures (eg, "Procedure Targeted" models), which provide opportunities to incorporate indication and other procedure-specific variables and outcomes to improve risk adjustment. In addition, comparative benchmark reports given to participating hospitals have been expanded considerably to allow more detailed evaluations of performance. Finally, procedures have been developed to estimate surgical risk for individual patients. This article describes the development of, and justification for, these new statistical methods and reporting strategies in ACS NSQIP.